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(54) Locating bar code symbols. 



(57) A bar code reader (10) includes an optical system (26, 28) for storing a two dimensional image in 
memory (32), which stored two dimensional image contains a bar code symbol. A method and apparatus 
is disclosed for detecting the location of the bar code image by computing the accumulated sum (64) of 
the products of the derivatives (62) of respective first and second scan tines (60) as a location score (68) 
for the image under consideration. The higher the location score, the higher the probability that the area 
under consideration contains a bar code image. Also, a method and apparatus is disclosed (Fig. 5B) for 
determining the fine orientation of a located bar code image by the cross-correlation of interpolated 
scan line data. The bar code image is filtered by shifting interpolated scan line data in accordance with 
the detected peak of the cross-correlation and combining the shifted scan line data. 
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This invention relates to the field of machine read- 
able symbols, and particularly to a method and 
apparatus for reading of bar code symbols. 

In our co-pending European patent application 
(published under the number EP-A 

) corresponding to United States application 
500,802 (Uoyd Wise, Tregear Case 34927) a bar 
code reader is disclosed which provides for high 
speed omnidirectional reading of multiple or stacked 
bar code symbols, or even damaged bar code labels, 
which may be at a random orientation, distance and 
relative motion with respect to the reader. 

A bar code Is a particular type of machine read- 
able symbol. A typical bar code includes parallel solid 
lines, or bars, of varying width and spacing. The alter- 
nating light and dark areas defined by the bars and the 
spaces between the bars, represent a digital code 
which serves to identify the content of the bar code 
symbol. After being read, the digital code is then 
directly translated to a sequence of alphanumeric 
characters and then by means of a data base, may be 
further translated to the common language descrip- 
tion of the item bearing the subject bar code label, 
along with other pertinent data, such as for example 
the current price of the item. 

A bar code may be read by scanning. Typically, 
a small spot of light is directed from a source of illumi- 
nation to the surface of the bar code. The reflected 
light is sensed by a photosensitive element The small 
illuminated spot of light is then swept across the bar 
code surface, all the whle sensing the intensity of the 
resulting reflected light Since light areas reflect more 
light than dark areas, the reflected light intensity rep- 
resents the digital code which serves to identify the 
content of the bar code symbol. 

In one type of bar code reader, a hand held laser 
or LED is used as the source of illumination, and the 
reader is manually swept across the barcode surface. 
In a scanning type of bar code reader, the light source 
is stationary while the light beam is moved in a scan- 
ning pattern. In a particular type of bar code scanner, 
a laser beam is swept through a complex series of 
repetitive geometric patterns in order to provide for 
some degree of omnidirectional scanning. However, 
due to the limitations of laser type bar code scanners, 
it is difficult to obtain reliable consistent bar code read- 
ing, particularly when used with damaged bar code 
labels. 

In another type of bar code reader, an image of a 

i,:.;seuuenr: ■. ,:;:ret. -ler^ 
■e : , f l.. e ;>-3 *; u„ . : w eve* , " l: . c e i ; > t .. , ...... 

an car cooe reaaer, \i nas suii oeen necessary to oos 
tion and orient the bar code to the reader. 

In general, in the prior art, it Is typically necessary 
for the operator to either orient the bar code, or other- 

v^e position the bar code and/or the -eader manual! , 
order to acnieve Drooer operation 



The present invention is embodied in a bar code 
reader in which bar codes are rapidly and reliably 
read. Furthermore, a bar code reader in accordance 
with the present invention provides for high speed 

5 omnidirectional reading of multiple or stacked bar 
code symbols, or even damaged bar code labels, 
which may be at a random orientation, distance and 
relative motion with respect to the reader. 

The embodiment of the bar code reader in 

10 accordance with the present invention described 
below includes 1) means for capturing and storing a 
two dimensional image in memory storage, which 
stored image includes a bar code symbol somewhere 
within the field of view, 2) detecting means for proces- 

15 sing the stored image for detecting a potential loca- 
tion, or locations, anywhere within the field of view of 
the stored image, each of which locations being likely 
to contain a bar code symbol, 3) orientation proces- 
sing means for determining the orientation of said 

20 detected bar code symbol at said detected location 
likely to contain a bar code symbol, 4) filtering means 
for filtering said detected barcode symbol in a direc- 
tion perpendicular to said determined orientation of 
said detected bar code symbol in order to utilize the 

25 redundancy of the bar code symbology, and 5) means 
for scanning through said detected bar code symbol 
at a location corresponding to said detected potential 
location and at an angle substantially corresponding 
to said determined orientation of said detected bar 

30 code symbol. 

The present invention is applied in the above 
embodiment and is particularly concerned with a 
method and apparatus for performing the second step 
in the above mentioned bar code reader, i.e. deter- 

35 mining which areas of the stored two dimensional 
image are the locations likely to contain a bar code 
symbol. 

To this end, the preferred practice of the invention 
provides that first, two parallel scan lines are selected. 

40 Then , the derivatives of the first and second scan I ines 
respectively, are calculated. Thereafter, the point by 
point product of respective derivatives of said first and 
second scan lines is computed. An accumulated total 
of the sum of the respective products of derivatives of 

45 the first and second scan lines is computed as a loca- 
tion score which represents the relative probability 
that the area of the stored two dimensional image 
under consideration contains a bar code symbol. The 
higher the location score for given area, the more 

. .■ ,.Oi,^. ( j;tjA., <;o oc u.:iere;k.i:.; jefwee <>, 

;eru pixei values. o\nce :ne oars gt a Dar ccae art 
black to white transitions, and vice versa, a scan 
55 across the bars will produce high magnitude differ- 
ence values, both positive and negative. It is sugges- 
ed '.hat the first and second scan lines be adjacent. 
■ l: i. -ict to c c lose. F c r example, it Is sugg este c that th e 
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first and second scan lines be four scan lines apart 
In the presence of a bar code, the approximate deri- 
vative of the second scan line will produce similar high 
magnitude difference values, both positive and nega- 
tive and in the same sequence as for the first scan s 
line. The product of the two approximate derivatives 
will be all high magnitude positive values since, for 
parallel bars, the high positive and high negative 
values will be aligned. In order to assure better align- 
ment at slight angles, and improve processing speed, to 
every other pixel value may be used in computing the 
approximate derivative. 

Another aspect of the present invention applied to 
the bar code reader embodiment outlined above, is 
particularly concerned with a method and apparatus 15 
for performing the third step in the above mentioned 

uai ovuo i eauct , i.c* ucwh it im nny mc unci iiauui i ui u ic 

detected bar code symbol at the detected location 
likely to contain a bar code symbol. 

To this end, the preferred practice of the invention 20 
provides that first, a plurality of parallel scan lines in 
a given area is selected. Then, processing parallel 
scan lines in pairs, first and second scan lines are 
interpolated to provide a smooth curve of first and sec- 
ond interpolated scan line data. Thereafter, first and 25 
second interpolated scan line data are cross-corre- 
lated. The cross-correlation function is a measure of 
the similarity, or correlation, between two curves as a 
function of the relative position of the two curves, i.e. 
as one curve is translated relative to the other curve. 30 
The peak of the cross-correlation function for the first 
and second interpolated scan line data represents the 
offset between the first and second scan lines. The 
detected position of the peak of the cross-correlation 
function and the distance between the first and sec- 35 
ond interpolated scan line data are used to calculate 
the fine orientation, or angle, of the bars of the bar 
code symbol- 
More specifically, if the peak of cross-correlation 
function is located at zero, then the first and second 40 
scan lines are exactly aligned. In the latter case, the 
orientation angle of the bar code is zero, i.e. the bar 
code is perpendicular to the first and second parallel 
scan lines. 

In the more general case, the location of the peak 45 
of the cross-correlaticn function represents the offset 
between the first and second scan lines. The calcu- 
lated offset is used to shift the two scan lines into 

Mf rxv\f* i«; <;niftf*<1 into ahnnrrv»nt t whirfi mmn^r 
sates for the angle between the scan lines and the bar 
code. The located peak of the cross-correlation is also 
a measurement of the fine orientation angle of the bar 55 

ode symbol. After the scan lines are aligned, the bar 
ode symbol is filtered by computing the average 
. aiue of the corresponding data joints of the shifted 
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and aligned scan line data. In the alternative, the 
median value of the corresponding data points of the 
shifted and aligned scan line data may be used to filter 
the bar code image. 

In order to calculate the actual fine orientation 
angle of the bar code symbol, the position of the peak 
of the cross-correlation function is used in conjunction 
with the known spacing between the first and second 
scan lines. In particular, the tangent of the angle of the 
bar code symbol Is the ratio of the offset between the 
first and second scan tries to the distance between 
the first and second scan lines. Thus, the fine orien- 
tation angle of the bar code symbol is the arctangent 
of the ratio of the calculated position of the peak of the 
cross-correlation function to the distance between the 
first and second scan lines. 

Finally, using the computed fine orientation angle 
of the bar code symbol, successive partial scans 
taken along the computed fine orientation angle are 
concatenated to form a complete scan. 

The present invention and its preferred practice 
will now be further described with reference to the 
embodiment illustrated in the accompanying draw- 
ings, in which: 

Rgure 1 is a block diagram, partially in flow chart 
form, indicating a method and apparatus in 
accordance with the present invention; 
Figure 2 is a block diagram of a system for a bar 
code reader in accordance with the present 
invention; 

Figure 3 is a graphical representation of a two 
dimensional image area illustrating individual 
cells used in determining location and orientation 
of a bar code symbol in accordance with the pre- 
sent invention; 

Rgure 3A is a representation of a portion of the 
image area of figure 3, which portion contains a 
bar code symbol; 

Figure 4 is a flow chart illustrating the control pro- 
gram for the ASIC controller of figure 2; 
Figures 5A and 5B show a flow chart illustrating 
the control program for the digital signal pro- 
cessor of figure 2; 

Figure 6A is a representation of a bar code sym- 
bol with two typical parallel scan lines, which may 
be utilized in conjunction with the embodiments of 
the present invention; 

Figure 6B Illustrates the reflectance signals from 

, .... - -. i: l , e e sen ■ . ■■■ > mr,^, t r e r *•? - ... . r- 

•j r ; rBS n oct3V9 SC3H lines of figure 6B 
Figure 6D illustrates the products of the signaJ dif- 
ferences for each of the respective data points for 
the signal differences shown in figure 6C, and the 

sum total of all products of the signal differences 
iJong two parallel scan lines utilized in conjunc- 
tion with the present invention; 
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Figure 7A is a representation of a black to white 
transition with two typical parallel scan lines, 
which may be distinguished from a bar code sym- 
bol in conjunction with the present invention; 
Figure 7B illustrates the reflectance signals from 
the two parallel scan lines of figure 7A; 
Figure 7C represents the signal differences be- 
tween successive data points along each of the 
two respective scan lines of figure 7B; 
Figure 7D illustrates the products of the signal dif- 
ferences for each of the respective data points for 
the signal differences shown in figure 7C r and the 
sum total of ail products of the signal differences 
along two parallel scan lines; 
Figure 8A Is an image of a bar code symbol at an 
angle to the direction of scan with a portion of the 
sCwTtMvd area indicated* 

Figure 8B illustrates the reflectance signal from 
one scan line of the scanned area Indicated in fig- 
ure 8A; 

Figure 8C illustrates the scan tine of figure 8B 

after processing by interpolation; 

Figure 8D shows one interpolated scan line and 

another interpolated scan line, four scan lines 

apart 

Figure 8E shows eight interpolated scan lines 
which have been shifted respectively into align- 
ment; 

Figure 8F shows the average of the eight interpo- 
lated and shifted scan lines of figure 8E; 
Figure 8G is a binary signal representation of the 
waveform of figure 8F using the overall signal 
average as the binary threshold value; 
Figure 9A is the cross-correlation function of the 
interpolated first and second scan lines of the por- 
tion of the scanned area in figure 8A; 
Figure 9B is a family of cross-correlation curves, 
each resulting from cross-correlating the first 
interpolated scan line with successive interpo- 
lated scan lines of the portion of the scanned area 
in figure 8 A; 

Figure 9C shows the peak values of the cross- 
correlation function for each interpolated scan 
line compared to the first interpolated scan line for 
the portion of the scanned area indicated in figure 
8A; and 

Figure 10 is an illustration of a bar code symbol, 
depicting the manner in which overlapping partial 



code image location and orientation 16 comprise the 
portion of the present bar code reader which serves 
to generally locate a bar code within a field of view. 
After the bar code image is located within the field 

5 of view and its coarse orientation determined, means 
1 8 are provided for determining the fine orientation of 
the bar code. Having located the bar code and deter- 
mining its fine orientation, means 20 forffitering the 
barcode, are provided. Thereafter, bar code scanning 

10 22 is performed. The operation of determining the fine 
orientation 18, bar code filtering 20, and bar code 
scanning 22, together comprise the portion of the pre- 
sent bar code reader which serves to "scan" a bar 
code once having been located within a field of view. 

15 After bar code scanning, a decoder 23 well known to 
those skilled in the art, provides the decoded barcode 



The operation of "scanning a bar code", as used 
in the prior art, relates to sweeping an illuminated spot 
20 across a bar code. As used herein, with respect to the 
present invention, the operation of "scanning a bar 
code" means to extract from image memory storage, 
sequential values derived from said image memory 
storage corresponding to reflectivities along a sweep 
25 traversing the bar code. 

A preferred hardware embodiment of the present 
invention is shown in figure Z An optical system 26 is 
coupled to an image sensor array 28. The output of 
the image sensor array 28 is converted from analog 
30 to digital in A/D converter 30, and stored in a first 
memory 32. The first memory 32 is preferably a 
dynamic random access memory (DRAM). A control- 
ler 34 which may be an application specific integrated 
circuit (ASIC) controls the image acquisition system 
35 so as to capture and digitize an image and store it in 
DRAM 32. The ASIC controller 34 also performs sev- 
eral other processing tasks under the control of a digi- 
tal signal processor 38. Digital signal processor 38 is 
typically a high speed microprocessor such as the 
40 ADSP-2101 available from Analog Devices, Nor- 
wood, Mass. The memory space for digital signal pro- 
cessor 38 is both ROM for program storage and a 
static random access memory 42 (SRAM) for image 
processing storage. Portions of the stored image 
45 memory in DRAM 32 are transferable to SRAM 42 
under the control of ASIC controller 34. Finally, an 
input terminal 40 is coupled to the input of digital sig- 
nal processor 38, and output terminal 44 is coupled to 



mage acautsrtJon system ^ wnicr; mauaes un- 
necessary optical and photosensitive elements, cap- 
tures an image of the reader's field of view, which cap- 
tured image may contain a bar code label 12. 

Once the image is acquired in memory, means 
provided for bar coce image location anc coars- 
orientation 18. Together. Image accuisttion * 4 and bar 



:..,uc signal on terminal h-,, :c a;gttai signal prccei>v, 
38. Responsive ;o the control outputs of digital signai 
processor 33, ASIC controller 34 acquires an image 
55 for storage in DRAM memory 32. Also responsive to 

control outputs of digital signal processor 38 

\S\C control lei 34 processes the stored mage : 
• RAM 32 so as to determine the potential location or 
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locations which are likely to contain a bar code sym- 
bol. For location processing, the image stored in 
DRAM 32 is divided into smaller areas, or cells, and 
a location score is assigned to each cell. The higher 
the location score for a given cell, the more likely is the 
cell to contain at least a partial bar code symbol. 

When the ASIC controller 34 has completed its 
location scoring task, digital signal processor 38 
examines the resulting scores and commands the 
ASIC controller 34 to transfer those image areas of 
Interest from DRAM 32 to SRAM 42. Digital signal pro- 
cessor 38 thereafter processes the partial image in 
SRAM 42 to determine the orientation of the stored 
bar code image, to filter the oriented bar code image 
along a direction perpendicular to the determined 
orientation, and to scan the oriented and filtered bar 

i _ : * AA»- *->>l »M4i< r\f tn+nroct hflVO hPAfl 

CUOe linejyCJ- r»noi on ^ «-«^-» w. "■«"-•■ 

transferred from DRAM 32 to SRAM 42 and proces- 
sed by digital signal processor 38, a complete bar 
code output scan is provided to decoder 23 which pro- 
vides a decoded bar code label output at terminal 44. 
Alternatively, the function of decoder 23, which may 
have serial or parallel output, may be included in the 
program of digital signal processor 38. 

On the other hand, if by examination of the loca- 
tion scores, no bar code was found in the stored 
image in DRAM 32, then digital signal processor 38 
through ASIC controller 34 may command the optical 
system 26, the image sensor array 28 and the A/D 
converter 30 to acquire another image in DRAM 32 for 
processing. The process of acquiring and processing 
images may continue until a bar code symbol is suc- 
cessfully scanned. 

The organization of the stored DRAM image area 
48 is shown in figure 3. The image sensor array 28 
(figure 2) has 768 pixels in the horizontal direction and 
576 pixels in the vertical direction. A suitable image 
sensor for use with the present invention is the MOS 
image sensor array 98268 available from Hitachi Cor- 
poration. The image area 43 is conceptually divided 
into cells, such as cell 49. Specifically, the image area 
48 is divided into 24 cells in the horizontal direction 
and 72 celts in the vertical direction, with each cell 
being 8 by 32 pixels. That is, each cell has 8 scan 
lines, with each scan line having 32 pixels. 

The image area 48 is divided into cells in each of 
four directions. That is, image area 48 is divided into 
horizontal cells such as cell 50. However, image area 



image area 48 and oriented 14 degrees off the vertical 
direction. A typical vertical cell 52 is shown superim- 
posed over a portion of bar code symbol 58. 

The portion of the program of the ASIC controller 

5 34 (figure 2) for determining the location or locations 
likely to contain a bar code symbol is shown In the flow 
chart of figure 4. For a given cell in image area 48, the 
process uses two scan lines, i.e. scan line A, and scan 
line B. Specifically, scan line A is the first of the eight 

10 scan lines of a given cell, and scan line B Is the fifth 
scan line of a given cell. After entering the location 
program, the approximate derivative of scan line A, 
and the approximate derivative of scan line B, are cal- 
culated at step 60. For this purpose, a derivative is 

15 approximated by taking the difference between any 
two consecutive pixels. In order to speed up the pro- 
cess of taking an approximate derivative, every other 
pixel is used in the calculation, i.e. instead of using ail 
32 pixels across a scan line of a given cell, every other 

20 pixel i.e. 16 pixels are used to approximate a deriva- 
tive. 

After finding the approximate derivatives at each 
point of scan line A and scan line B at step 60, the 
point by point product of both derivatives is calculated 
25 at step 62. Thereafter, the sum of the products of deri- 
vatives is accumulated at step 64. This process of 
accumulating the sum of the product of derivatives 
continues until all the points of scan lines A and B are 
completed for this cell at step 66, At this point, the 
30 accumulated product of derivatives constitutes the 
location score for this particular cell/ The location 
score is then stored in SRAM at step 68. The program 
increments to the next cell in the image area at step 
70. The process of computing location scores con- 
35 tinues from cell to cell until the end of the image area 
is detected at step 72, and the program is exited. 

The process of computing a location score for a 
cell is illustrated in figures 6A through 6D. In figure 6A, 
scan line A and scan line B are shown at a slight angle 
40 across a portion of a bar code symbol. Figure 6B 
shows the reflectance signals at approximately 1.5 
pixels per narrow bar for both scan line A and scan 
line B. The data points are simply connected by 
straight lines. Figure 6C shows the result of taking the 
45 difference between successive data points along 
scan line A and successive data points along scan 
line B to produce an approximate derivative shown as 
delta scan line A and delta scan line B, respectively, 
t^qure 6D shows the product of each data point alonq 
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diagonal i.e. 135 degrees such as ceil 54. Using four 
directions of scan lines permits the location process 
to also determine the coarse orientation of the located 

i r code image in the same operation. 

r: or ourposes of illustration, figure 3A. snowa ,i bm 
...::..x:3e symbol somewhere within fieiC of view 



( eacn caia point is :ne proa u a oi tne approximate 
derivatives of eacn respective data point of scan line 
A and scan line B. Adding up the sum of the deriva- 
55 tives produces a location score equal to 810, which is 
a relatively high score because scan line A and scan 
r e B are directly through a bar code symbol. 

r o illustrate the ability of the location algorithm x 
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distinguish bar codes from simple transitions between 
black and white areas, figures 7A through 7D indicate 
the corresponding location score for a simple black to 
white transition. Figure 7A shows an image with a 
black to white transition with two scan lines, scan line s 
A and scan line B therethrough. Figure 7B shows the 
reflectance signals for scan line A and scan line B. 
Figure 7C shows the approximate derivative or delta 
scan line A and delta scan line B t while figure 7D 
shows the sum of the derivatives for each point on 10 
both scan line A and scan line B. The resulting loca- 
tion score of 57 from figure 7D for the image in figure 
7A is considerably less than the location score of 81 0 
for the bar code in figure 6A. 

The program flow chart for the digital signal pro- is 
cesser 38 in figure 2, is shown in figures 5A and 5B. 
Responsive to an input signal on terminal 40 of figure 
2, to initiate a bar code read, the digital signal pro- 
cessor 38 enters the program as shown in the flow 
chart of figure 5A. The first step 74, Is to command the 20 
ASIC controller to capture the image area to DRAM. 
Once the image area is captured, the next step 76 is 
to command the ASIC controller to perform the bar 
code location algorithm (in accordance with the flow 
chart of figure 4, discussed above) for one direction 25 
i.e. the horizontal direction. As the location algorithm 
is performed for all cells in the horizontal direction in 
image area 48, the ASIC controller stores the results 
in SRAM. Each cell score, is an indication of the likeli- 
hood of bar code activity. The complete set of scores 30 
for a given direction forms a map of the likely regions 
of bar code activity. This process is repeated for ail 
four directions i.e. location scores for a vertical scan 
are computed and stored in SRAM thorough program 
loop 80; location scores for a rising diagonal scan, I.e. 35 
a 45 degree scan, are computed and stored in SRAM 
thorough program loop 82; and location scores for a 
falling diagonal scan, i.e. a 1 35 degree scan, are com- 
puted and stored in SRAM thorough program loop 34. 

Once the cell activity score map for a particular 40 
direction has been computed and stored in SRAM, the 
digital signal processor program determines whether 
or not bar code activity is present at step 78, For this 
purpose, a simple threshold may be utilized, examin- 
ing all location scores that exceed a given threshold. 45 
If no score exceeds a given threshold, then no bar 
code activity is found, and the program repeats start- 
ing from step 74 in which the ASIC controller captures 
a new image area to DRAM. However, rf ber code 

~ta; ::rc cesser Troorar . r . A — - - •• 

tne located bar code. 

The first step is to determine from the location 
scores stored in SRAM, the center of the region of bar 55 
code activity, and the likely horizontal and vertical 

^tent cf such activity, at step 36. "^"he approximate 
enter and extent of sar ccce activity may be aete r 
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mined by region growing applied to the ceil activity 
score map. Region growing is a common image pro- 
cessing task to identify a particular region of an overall 
image which particular region possesses a specific 
characteristic in this case, large values. Region grow- 
ing is a technique well known to those skilled in the art 
of image processing, and is disclosed in "MATRIX 
STRUCTURED IMAGE PROCESSING" by 
Dougherty and Giardina, published 1987 by Prentice- 
Hall Inc, Englewood Cliffs, New Jersey 07632. 

After the region of interest has been determined, 
the digital signal processor commands the ASIC con- 
troller to transfer the image area containing bar code 
activity from DRAM to SRAM at step 88. SRAM mem- 
ory space is generally smaller than DRAM memory 
space, and typically represents a few percent of the 
total image area stored in DRAM. Although SRAM is 
generally faster than DRAM, the use of a relatively 
smaller SRAM is more economical since the cost of 
SRAM Is typically more than DRAM. Also, the area of 
the image stored in SRAM may or may not be related 
to the size of the cell areas from the DRAM image 
memory. Due to the smaller size of the SRAM, the lat- 
ter may hold only a portion of a bar code, in which 
case processing steps are repeated for partial scans 
and the partial scans later combined to form a com- 
plete scan. 

Once the image is transferred to SRAM memory, 
the digital signal processor interpolates each of the 
scan lines of data for a given image area of interest 
at step 90. The process of interpolation is well known 
to those skilled in the art of digital signal processing, 
and is described by Peled and Liu in "DIGITAL SIG- 
NAL PROCESSING theory, design, and implemen- 
tation", published 1976 by John Wfley and Sons. 
Interpolation increases the effective sampling rate of 
the scan line data by fitting the best curve to the data 
with frequencies below the Nyquist limit 

The bar code image is initially sampled at about 
1.5 pixels per narrow bar. To create a smoother curve, 
the signal is upsampled by four times. In simple terms, 
rather than connecting the data points by straight 
lines, additional data points are added between the 
actual data points to form a smoother curve. 

After interpolating each of the scan lines at step 
90, the first scan line of a given cell is cross-correlated 
with successive adjacent interpolated scan line data 
as indicated in step 92. Cross-correlation provides a 
measure cf the similarity, or match, between two cur- 



^SSING CP SPEECH SIGNALS" t-y Kac-iner anc 
Schafer published 1978 by Prentiss Hall, Englewooc 
Cliffs, NJ 07632. 

Successive cross-correlation between adjacent 

terpolateo scar - \re cata ^ravkles 3 means tc dete: 
•^ne the r tne orientation z* the Dsr code svnDoi aisc 
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at step 92. The detected fine orientation of the bar 
code is derived from the difference between the aver- 
age peaks of successive cross-correlations between 
adjacent interpolated scan lines. The position of the 
peak of the cross-correlation function of two scan 
lines represents the amount one scan line of data 
must be shifted in order to provide the best alignment 
with the other scan line of data. Calculation of the 
actual angle of the bars is discussed below in relation 
to figure 9A through figure 9C. 

After the fine orientation of the bar code is known, 
each interpolated scan line data is shifted into align- 
ment at step 94. After the interpolated scan line data 
has been shifted into alignment, the average of all 
scan lines is computed. At this point the bar code 
symbol may be decoded into a partial bar code scan 
at step 94. 

The partial bar code scan is stored at step 94, and 
the next stored region of interest is determined at step 
96. That is, the next area of interest which is likely to 
contain a bar code 'mage is then transferred from 
DRAM to SRAM at step 88. The process of interpo- 
lation and cross-correlation is repeated until another 
partial bar code scan, representing an adjacent image 
area of interest, is stored. 

Once ail of the stored regions containing bar code 
activity have been scanned, the partial scans are con- 
catenated, or connected to form a complete scan at 
step 98. Finally, at step 98 the output scan is forwar- 
ded to a decoder, known to those skHled in the art, for 
converting the complete concatenated bar code scan 
into a sequence of alphanumeric characters which 
represent the content of the bar code. 

Figures 8A through 8G and figures 9A through 9C 
illustrate the processes for detecting fine orientation, 
filtering and scanning of a bar code that has been 
located in a given cell. Specifically, figure 8A illus- 
trates a vertical cell 52 consisting of 8 scan lines 
superimposed over a portion of a bar code label 58. 
The poor appearance, or spottiness of the bars is 
actually representative of the condition of many prin- 
ted bar code labels encountered in practice. 

Figure 8B shows the 32 pixels of the first scan line 
of ceil 52 connected by straight lines. Figure 8C 
shows the same 32 data points after interpolation, or 
upsampling by four times. Figure 8D shows one 
upsampled scan line, and another upsampied scan 
line which is 4 scan lines away. It is evident there is 



Note that the peak is at a lag of about minus one. This 
means that over a distance from one scan line to the 
next, the waveform Is shifted one upsampled pixel, or 
one fourth of an original pixel. This yields a bar code 
5 slope of one fourth, or 0.25, which corresponds well 
with the measured slope of about 14 degrees, since 
the arctangent of 0.25 equals 14.036 degrees. 

Figure 9B shows a family of cross-correlation cur- 
ves. Each curve is the result of cross-correlating the 
10 first scan line with the scan line successively further 
away. Note that the peaks step over extremely con- 
sistently by one for each curve. By using interpolation, 
it is possible to find the position of a peak in the cross- 
correlation function to fractional pixel accuracy. Fig- 
is ure 9C is a plot of the cross-correlation function for 
each scan line compared to the first scan line of the 
given area of interest Note that the calculated peak 
values lie almost perfectly along a straight line, the 
slope of which represents the fine orientation angle of 
20 the bar code symbol. In general, not all of the peak 
values may lie on a straight line, in which case the 
average slope may be taken to represent the fine 
orientation of the bar code symbol. 

Once the fine orientation of the bars is known, 
25 each of the interpolated scan line data is shifted into 
alignment as shown In figure 8E, and the average 
value taken as shown in figure SF. Taking the average 
of corresponding sample points from the shifted lines 
of interpolated scan line data, provides a simple 
30 approach to bar code filtering. Averaging effectively 
filters perpendicular to the orientation of the bar code. 
In the alternative, the median value of each data point 
could be used to reduce the effect of occasional mis- 
sing pieces of the bar code label. That is, a white spot 
35 on a black bar effects the median data value less than 
the average data value. Another approach is to take 
a weighted average based on cross-correlation 
scores to provide better rejection of poorly correlated 
scan line data. In the latter case, those interpolated 
40 scan lines that correlate well with each other would 
count more heavily in the average, while those inter- 
polated scan lines which cross-correlate poorty would 
weight the average correspondingly less. 

As used herein, "shifting" scan line data includes 
45 both actual shifting of scan line data within the image 
memory as well as virtual shifting of scan line data by 
the use of an offset vector to be added to the location 
of sequential values extracted from said memory. 



■ ,::;ii;vt::: r :nentaoor ;r*set v :,an 
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; $ necessary 10 compute uie magnttuce of trie 
offset, i.e. the actual orientation angle of the bars. The 
cross correlation function is well suited for this task 

Figures 9A through 9C illustrate the process of 

■'eterrnining the fine orientation of the bar code syrrv 

a "vgure 9 A shows the cross-ccrreiation 'unction 
the frst and second scan Sines of the sampled signal. 



.;;r:!evec ros^-ccrretatio.'': ieiecte- 
...^i: j r ;t data aicr;t, ^anouumerooiauc;; 
can iine data if there are yuffideOi date* points, oi 
pixels per narrow bar. Otherwise, Interpolation te used 
to generate the additional data points for the cross- 
55 correlation to be meaningful. Finally, in shifting scan 
nes into alignment, all successive scan line data may 
© correlated to a single reference iine, or in the alter™ 
-ative, successive scan line data may be correlates 
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In line pairs and not referenced to a single scan line. 

The aggregate waveform in figure 8F is then con- 
verted to a binary value waveform as shown in figure 
8G using the overall signal average as the binary 
threshold. The zero level of the waveform in figure 8G 
corresponds to the black level of the bar code in figure 
8A, while the one level corresponds to the white level. 

Thus, a partial scan of the bar code shown in fig- 
ure 8A corresponding to the cell 52 has been perfor- 
med. Figure 10 shows how successive partial scans 
100, 102 and 104 may be concatenated to form a 
complete scan of bar code 58. The partial scans over- 
lap each other so that no bar code data is lost The 
successive partial scans are taken in steps along an 
angle corresponding to the measured fine orientation 
of the bars. That is, since the fine orientation of the 
bars is 14 degrees, a staircase of partial scans along 
a 14 degree angle off the vertical, is constructed in 
order to acquire partial scans which can be concate- 
nated into a complete scan of the bar code label. 

Thus, a bar code reader has been disclosed 
which is capable of reading a bar code symbol con- 
tained anywhere within the field of view of an image 
area in an omnidirectional manner. Although the 
embodiment disclosed suggests the use of an area 
image capture device, it wBI be appreciated that a 
linear image capture device as may be used with a 
moving conveyor belt, may also be used. 



Claims 

1. In a bar code reader, a method for detecting the 
location of a bar code symbol comprising: 

capturing a two dimensional image for 
storage in a memory, said stored two dimensional 
image containing an image of a bar code symbol 
anywhere within the field of view of said stored 
two dimensional image; 

approximating the derivative of a first scan 
line in a given area of said stored two dimensional 
image; 

approximating the derivative of a second 
scan line substantially parallel to said first scan 
line in said given area of said stored two dimen- 
sional image; 

multiplying said derivative of said first scan 
line and said derivative of said second scan line 
-^nectivelv to obtain i orodu ct of said denvatrvo 



tains a bar code image. 

2. A method in accordance with claim 1 , for detect- 
ing the location of a bar code symbol, wherein 

5 said steps of approximating the derivatives of 

said first and second scan lines respectively com- 
prises: 

subtracting a previous pixel value from a 
present pixel value along said first scan line to 
10 determine the approximate derivative of said first 

scan line; and 

subtracting a previous pixel value from a 
present pixel value along said second scan line to 
determine the approximate derivative of said sec- 
15 ond scan line. 

3. A method in accordance with claim 1 or 2. for 
detecting the location of a barcode symbol further 
comprising: 

20 determining whether said location score 

corresponding to said given area exceeds a pre- 
determined threshold, 

wherein said location score exceeding 
said predetermined threshold is an indication that 

25 said given area of said stored two dimensional 

image contains a bar code image. 

4. A method in accordance with claim 1 or 2, for 
detecting the location of a barcode symbol further 

jo comprising: 

storing respective location scores for a 
plurality of areas of said stored two dimensional 
image; and 

determining by region growing, which of 
35 said plurality of areas of said stored two dimen- 

sional image have respective location scores 
which correspond to a region which includes said 
located bar code image. 

40 5, in a barcode reader, a method for determining the 
orientation of a bar code symbol comprising: 

capturing a two dimensional image for 
storage in a memory, said stored two dimensional 
image containing an image of a bar code symbol 
45 anywhere within the field of view of said stored 

two dimensional image; 

interpolating a first scan line in a given 
area of said stored two dimensional image; 

interpolating a second scan line substan- 
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products of said derivative at said first scan iine 
and said derivative of said second scan line to 
provide a location score for said stored two 55 

dimensional image, wherein said location score 

presents the relative 'ikelihood mat said g;ve- 
irea of said stored two dimensional image cor- 
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_ t said interpolated first scan ime cata ana San- 
interpolated second scan line data; and detecting 
the peak of said cross-correlation function of said 
first and second interpolated scan line data, whe- 

-eln the position of said peak of said cross-oc re- 
gion function of said interpolated r irst am: 
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second scan line data corresponds to the orien- 
tation of said bar code image. 

6. A method in accordance with claim 5, further com- 
prising: 

shifting said interpolated second scan line 
data so as to be aligned with said interpolated first 
scan line data in accordance with said detected 
peak of said cross-correiation function of said 
interpolated first and second scan line data. 

7. A method in accordance with claim 5, for deter- 
mining the orientation of a bar code symbol 
further comprising: 

interpolating a plurality of scan lines in said 
given area of said stored two dimensional image; 
and 

calculating the respective cross-corre- 
lation function of selected pairs of interpolated 
scan lines from said plurality of interpolated scan 
lines. 

8. A method in accordance with daim 7, further com- 
prising; 

shifting said interpolated plurality of scan 
line data respectively so as to be aligned. 

9. A method in accordance with claim 8, further com- 
prising: 

filtering said bar code image by taking the 
average of corresponding data points from said 
plurality of shifted and interpolated scan line data. 

1 0. A method in accordance with claim 8, further com- 
prising: 

filtering said bar code image by taking the 
median of corresponding data points of said 
plurality of shifted and interpolated scan line data. 

1 1 . A method in accordance with claim 8, further com- 
prising: 

filtering said bar code image by taking the 
weighted average of corresponding data points of 
said plurality of shifted and interpolated scan line 
data, said average being weighted according to 
the magnitude of said cross-correlation function 
between said plurality of said respective interpo- 
sed scan line data and said plurality of interno 



converting said fltered bar code image to 
a binary function using the average value of said 
combined shifted and interpolated plurality of 
scan line data as the binary threshold value. 

5 

14. In a bar code reader, an apparatus for detecting 
the location of a bar code symbol comprising: 

means for capturing a two dimensional 
image for storage in a memory, said stored two 

10 dimensional image containing an image of a bar 
code symbol anywhere within the field of view of 
said stored two dimensional Image; 

means for approximating the derivative of 
a first scan line in a given area of said stored two 

is dimensional image; 

means for approximating the derivative of 
a second scan line substantially parallel to said 
first scan line in said given area of said stored two 
dimensional image; 

20 means for multiplying said derivative of 

said first scan line and said derivative of said sec- 
ond scan line respectively to obtain a product of 
said derivative of said first scan line and said deri- 
vative of said second scan line respectively; and 

25 means for accumulating the sum of the 

respective products of said derivative of said first 
scan line and said derivative of said second scan 
line to provide a location score for said stored two 
dimensional image, wherein said location score 

30 represents the relative likelihood that said given 

area of said stored two dimensional Image con- 
tains a bar code image. 

1 5. An apparatus in accordance with claim 14, for 
35 detecting the location of a barcode symbol, whe- 

rein said means for approximating the derivatives 
of said first and second scan lines respectively 
comprises: 

means for subtracting a previous pixel 
40 value from a present pixel value along said first 

scan line to determine the approximate derivative 
of said first scan line; and 

means for subtracting a previous pixel 
value from a present pixel vaiue along said sec- 
45 ond scan line to determine the approximate deri- 

vative of said second scan line. 

16 An apparatus in accordance with claim 14 or 15, 



comprising: 

filtering said bar code image by combining 
corresponding data points of said shifted and 
"nterpolated olurallty of scan line data. 55 

■ i neth CG f ; i v..-:;o re a r c> ■ * ■ ■ .: J air. " i > "C ■ t- 

comprising: 
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j on score corresponding x. sate grven area 
exceeds a predetermined threshold, 

wherein said location score exceeding 
said predetermined threshold a an indication that 
■iatd gven area of said stored two dimensional 
m age contains a bar code image, 
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17. An apparatus in accordance with claim 14 or 15, 
for detecting the location of a bar code symbol 
further comprising: 

means for storing respective location 
scores for a plurality of areas of said stored two 
dimensional image; and 

means for determining by region growing, 
which of said plurality of areas of said stored two 
dimensional Image have respective location 
scores which correspond to a region which 
includes said located bar code image. 



comprising: 

means for shifting said interpolated 
plurality of scan line data respectively so as to be 
aligned. 

5 

22. An apparatus in accordance with claim 21 , further 
comprising: 

means for filtering said bar code image by 
taking the average of corresponding data points 
10 from said plurality of shifted and interpolated scan 

line data. 
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18, In a bar code reader, an apparatus for determin- 
ing the orientation of a bar code symbol compris- 
ing: 15 

means for capturing a two dimensional 
image for storage in a memory, said stored two 
dimensional image containing an image of a bar 
code symbol anywhere within the field of view of 
said stored two dimensional image; 

means for interpolating a first scan line in 
a given area of said stored two dimensional 
image; 

means for interpolating a second scan line 
substantially parallel to said first scan line in said 
given area of said stored two dimensional image; 

means for calculating the cross-correlation 
function of said interpolated first scan line data 
and said interpolated second scan line data; and 

means for d etecting the peak of said cross- 
correlation function of said first and second inter- 
polated scan line data, wherein the position of 
said peak of said cross-correlation function of 
said interpolated first and second scan line data 
corresponds to the orientation of said bar code 
image. 

19. An apparatus in accordance with claim 1 8, further 
comprising: 

means for shifting said interpolated sec- 
ond scan line data so as to be aligned with said 
interpolated first scan line data in accordance 
with said detected peak of said cross-correlation 
function of said interpolated first and second scan 
line data. 45 

20. An apparatus in accordance with claim 18, for 
determining the orientation of a bar code symbol 



23. An apparatus in accordance with claim 21 , further 
comprising: 

means for filtering said bar code image by 
taking the median of corresponding data points of 
said plurality of shifted and interpolated scan line 
data. 



24. An apparatus in accordance with claim 28, further 
comprising: 

means for filtering said bar code image by 
taking the weighted average of corresponding 
data points of said plurality of shifted and interpo- 
25 lated scan line data, said average being weighted 

according to the magnitude of said cross-corre- 
lation function between said plurality of said res- 
pective interpolated scan line data. 

30 25. An apparatus in accordance with claim 20 or 21 , 
further comprising: 

means for filtering said bar code image by 
combining corresponding data points of said shif- 
ted and interpolated plurality of scan line data. 

35 

26. An apparatus in accordance with claim 25, further 
comprising: 

means for converting said filtered bar code 
image to a binary function using the average 
40 value of said combined shifted and interpolated 

plurality of scan line data as the binary threshold 
value. 



27. I n a bar code read er, a method for determining the 
orientation of a bar code symbol comprising: 

capturing a two dimensional image for 
storage in a memory, said stored two dimensional 
image containing an image of a bar code symbol 



means for calculating the respective 
cross-correlation function of selected pairs of 
interpolated scan lines from said plurality of said 55 

nterpolated scan ines 

21 .. An apparatus ;n acccraar.ce wrth ^ain ;x, -i.rr £•» 



: , .lureo two c mansion ai image, 

selecting a seconc scan iine suDstantiaiiy 
parallel to said first scan line in said given area of 
said stored two dimensional image; 

calculating the cross-correlation 'incticr 
: :aic selected Irst scan ;ine ana saic seiectec 
second scan line; anc 



19 



EP 0 449 645 A1 



20 



detecting the peak of said cross-corre- 
lation function of said first and second selected 
scan lines, wherein the position of said peak of 
said cross-correlation function of said selected 
first and second scan lines corresponds to the 5 
orientation of said bar code image. 

28. A method in accordance with claim 27, further 
comprising; 

shifting said selected second scan line so 10 
as to be aligned with said selected first scan line 
in accordance with said detected peak of said 
cross-correlation function of said selected first 
and second scan lines. 

15 

29. A method in accordance with claim 27 or 28, for 
Hofgrrnininn the orientation of a bar code symbol 
further comprising: 

selecting a plurality of scan lines in said 
given area of said stored two dimensional image; 20 
and 

calculating the respective cross-corre- 
lation function of selected pairs of selected scan 
lines from said plurality of selected scan lines. 

25 

30. A method in accordance with claim 29, further 
comprising: 

shifting said selected plurality of scan lines 
respectively so as to be aligned. 

30 

31. A method in accordance with claim 30, further 
comprising: 

filtering said bar code image by taking the 
average of corresponding data points from said 
plurality of shifted and selected scan tines. 35 

32. A method in accordance with claim 30, further 
comprising: 

filtering said bar code image by taking the 
median of corresponding data points of said 40 
plurality of shifted and selected scan lines. 

33. A method in accordance with claim 30, further 
comprising: 

filtering said bar code image by taking the 45 
weighted average of corresponding data points of 
said plurality of shifted and selected scan lines, 
said average being weighted according to the 

- -^oitt-rip o< ^aid Toss-comelatlor function be 



35. A method in accordance with claim 34, further 
comprising: 

converting said fltered bar code image to 
a binary function using the average value of said 
combined shifted and selected plurality of scan 
lines as the binary threshold value. 

36. In a bar code reader, an apparatus for determin- 
ing the orientation of a bar code symbol compris- 
ing: 

means for capturing a two dimensional 
image for storage in a memory, said stored two 
dimensional image containing an image of a bar 
code symbol anywhere within the field of view of 
said stored two dimensional image; means for 
selecting a frrst scan line in a given area of said 
stored two dimensional image; 

means for selecting a second scan line 
substantially parallel to said first scan line In said 
given area of said stored two dimensional image; 

meansfor calculating the cross-correlation 
function of said selected first scan line and said 
selected second scan line; and 

means for detecting the peak of said cross- 
correlation function of said first and second selec- 
ted scan lines, wherein the position of said peak 
of said cross-correlation function of said selected 
first and second scan lines corresponds to the 
orientation of said barcode image. 

37. An apparatus in accordance with claim 36, further 
comprising: 

means for shifting said selected second 
scan line so as to be aligned with said selected 
first scan line in accordance with said detected 
peak of said cross-correlation function of said 
selected first and second scan lines. 

38. An apparatus in accordance with claim 36, for 
determining the orientation of a bar code symbol 
further comprising: 

meansfor selecting a plurality of scan lines 
in said given area of said stored two dimensional 
image; and 

means for calculating the respective 
cross-correlation function of selected pairs of 
selected scan lines from said plurality of said 
selected scan lines. 



34. A method in accordance with claim 29 or 30, 
further comprising: 

filtering said bar code : nage by combining 
res ponding data joints '>aKj vniftecl anH 
e ec:ed plurality of scan :lnes. 



.^ii lines respectively so as to oe aiignec, 

40. An apparatus in accordance with claim 39, further 

comprising: 

means f cr filter.ng said Dar code image by 
.ah;ny the average of corresponding data potnte 
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from said plurality of shifted and selected scan 
lines. 

41. An apparatus in accordance with claim 39, further 
comprising: 5 

means for filtering said barcode image by 
taking the median of corresponding data points of 
said plurality of shifted and selected scan lines. 

42. An apparatus in accordance with claim 39, further 10 
comprising; 

means for filtering said bar code image by 
taking the weighted average of corresponding 
data points of said plurality of shifted and selected 
scan lines, said average being weighted accord- 15 
ing to the magnitude of said cross-correlation 

ft inrrtfnn hRhjva«n eairi nlnralih^ rvf co;«-f r^^r-.*-*^^.*-,. 

. f^.M.un^j v>l uuiu ■ WtJp^WUVCS 

selected scan lines. 

43. An apparatus in accordance with claim 38 or 39, 20 
further comprising: 

means for filtering said bar code image by 
combining corresponding data points of said shif- 
ted and selected plurality of scan lines. 

25 

44. An apparatus in accordance with claim 43, further 
comprising: 

means for converting said filtered barcode 
image to a binary function using the average 
value of said combined shifted and selected 30 
plurality of scan lines as the binary threshold 
value. 
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